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Abstract — We consider the problem of routing packets across 
a multi-hop network consisting of multiple sources of traffic 
and wireless links while ensuring bounded expected delay. Each 
packet transmission can be overheard by a random subset of 
receiver nodes among which the next relay is selected oppor- 
tunistically. The main challenge in the design of minimum- 
delay routing policies is balancing the trade-off between routing 
the packets along the shortest paths to the destination and 
distributing traffic according to the maximum backpressure. 
Combining important aspects of shortest path and backpressure 
routing, this paper provides a systematic development of a 
distributed opportunistic routing policy with congestion diversity 
(D-ORCD). 

D-ORCD uses a measure of draining time to opportunistically 
identify and route packets along the paths with an expected 
low overall congestion. D-ORCD is proved to ensure a bounded 
expected delay for all networks and under any admissible traffic. 
Furthermore, this paper proposes a practical implementation 
which empirically optimizes critical algorithm parameters and 
their effects on delay as well as protocol overhead. Realistic 
Qualnet simulations for 802. 11 -based networks demonstrate a 
significant improvement in the average delay over comparative 
solutions in the literature. 

Index Terms — wireless, ad-hoc networks, routing, congestion, 
implementation 



I. Introduction 

Opportunistic routing for multi-hop wireless ad-hoc net- 
works has long been proposed to overcome deficiencies of 
conventional routing (TJ-J5J. Opportunistic routing mitigates 
the impact of poor wireless links by exploiting the broadcast 
nature of wireless transmissions and the path diversity. More 
precisely, the routing decisions are made in an online manner 
by choosing the next relay based on the actual transmission 
outcomes as well as a rank ordering of neighboring nodes. 

The authors in (4) provided a Markov decision theoretic 
formulation for opportunistic routing and a unified framework 
for many versions of opportunistic routing (TJ-(3), with the 
variations due to the authors' choices of costs. In particular, it 
is shown that for any packet, the optimal routing decision, 
in the sense of minimum cost or hop-count, is to select 
the next relay node based on an index. This index is equal 
to the expected cost or hop-count of relaying the packet 
along the least costly or the shortest feasible path to the 
destination. When multiple streams of packets are to traverse 
the network, however, it might be necessary to route some 
packets along longer or more costly paths, if these paths 
eventually lead to links that are less congested. More precisely, 



and as noted in (6), (7), the opportunistic routing schemes in 
(TJ-J5) can potentially cause severe congestion and unbounded 
delays (see examples given in (6)). In contrast, it is known 
that an opportunistic variant of backpressure [8], diversity 
backpressure routing (DIVBAR) [7] ensures bounded expected 
total backlog for all stabilizable arrival rates. To ensure 
throughput optimality (bounded expected total backlog for 
all stabilizable arrival rates), backpressure-based algorithms 
(7), (8) do something very different from (TJ-J5): rather than 
using any metric of closeness (or cost) to the destination, 
they choose the receiver with the largest positive differential 
backlog (routing responsibility is retained by the transmitter 
if no such receiver exists). This very property of ignoring 
the cost to the destination, however, becomes the bane of 
this approach, leading to poor delay performance in low to 
moderate traffic (see (6)). Other existing provably throughput 
optimal routing policies |9)-|T2| distribute the traffic locally 
in a manner similar to DIVBAR and, hence, result in large 
delay. 

Recognizing the shortcomings of the two approaches, re- 
searchers have begun to propose solutions which combine 
elements of shortest path and backpressure computations (7), 
(T5) , p6| . In (7), E-DIVBAR is proposed: when choosing 
the next relay among the set of potential forwarders, E- 
DIVBAR considers the sum of the differential backlog and the 
expected hop-count to the destination (also known as ETX). 
However, as shown in [6], E-DIVBAR does not necessarily 
result in a better delay performance than DIVBAR. Instead 
of a simple addition used in EDIVBAR, this paper provides 
a distributed opportunistic routing policy with congestion 
diversity (D-ORCD) under which the congestion information 
is integrated with the distributed shortest path computations of 
(4). In our previous work (13), ORCD, a centralized version 
of D-ORCD, is shown to be throughput optimal without 
discussion on system implications. In this paper, we extend 
the throughput optimality proof for the distributed version 
and discuss implementation issues in detail. We also tackle 
some of the system level issues observed in realistic settings 
via detailed Qualnet simulations. We then show that D-ORCD 
exhibits better delay performance than state of the art routing 
policies, namely, EXOR, DIVBAR and E-DIVBAR. 

Before we close, we emphasize that some of the ideas 
behind the design of D-ORCD have also been used as guiding 
principles in many routing solutions: some in opportunistic 
context p4| , (15) and some in conventional context (16). 



Below, we detail the similarity and differences between these 
solutions and our work for the sake of completeness, even 
though, in our study, we have chosen to focus only on 
solutions with comparable overhread and similar degree of 
practicality. In [14], perhaps the most related work to ours, 
the authors consider a flow-level model of the network and 
propose a routing policy referred to as min-backlogged-path 
routing, under which the flows are routed along the paths with 
minimum total backlog. In this light, D-ORCD can be viewed 
as a packet-based version of the min-backlogged-path routing 
without a need for the enumeration of paths across the network 
and costly computations of total backlog along paths. In p5| , 
authors propose a modified version of backpressure which uses 
the shortest path information to minimize the average number 
of hops per packet delivery, while keeping the queues stable. 
In (16), a modified throughput optimal backpressure policy, 
LIFO-Backpressure, is proposed using LIFO discipline at layer 
2. Neither of these approaches lend themselves to practical 
implementations: (15) requires maintaining large number of 
virtual queues at each node increasing implementation com- 
plexity, while 1 16] uses atypical LIFO scheduler resulting in 
significant reordering of packets. Furthermore, while LIFO- 
Backpressure policy guarantees stability with minimal queue- 
length variations, realistic bursty traffic in large multi-hop 
wireless networks may result in queue-length variations and 
unnecessarily high delay. 

The paper is organized as follows. In Section [TTJ we describe 
the D-ORCD routing algorithm. In Section III we discuss var- 
ious protocol implementation issues of D-ORCD. Section [IV 
describes our simulation results in detail, where we compare 
the performance of various routing policies with D-ORCD. We 
then discuss theoretical guarantees of D-ORCD in Section [V] 
We provide concluding remarks and discuss directions for 
future research work in Section [VI] The appendix contains 
proofs of throughput optimality of D-ORCD under certain 
assumptions on the model. 

II. Opportunistic Routing with Congestion 
Diversity 

The goal of this paper is to design a routing policy with im- 
proved delay performance over existing opportunistic routing 
policies. In this section, we describe the guiding principle and 
the design of Opportunistic Routing with Congestion Diversity 
(D-ORCD). We propose a time- varying distance vector, which 
enables the network to route packets through a neighbor with 
the least estimated delivery time. 

D-ORCD opportunistically routes a packet using three 
stages of: (a) transmission, (b) acknowledgment, and (c) 
relaying. During the transmission stage, a node transmits a 
packet. During the acknowledgment stage, each node that 
has successfully received the transmitted packet, sends an 
acknowledgment (ACK) to the transmitter node. D-ORCD 
then takes routing decisions based on a congestion- aware 
distance vector metric, referred to as the congestion measure. 
More specifically, during the relaying stage, the relaying 
responsibility of the packet is shifted to a node with the least 
congestion measure among the ones that have received the 



TABLE I 
Notations used in the description of the algorithm 



Symbol 


Definition 


N{i) 


Neighbours of node i 


vf(t) 


Congestion measure at node i at time t 


y(i,d) {t) 


Congestion measure obtained at node i from k 


T(t) 


Ending time of the latest computation cycle before time t 


T c 


Duration of the computation interval 


T s 


Control packet transmission interval 


Li(t) 


Local congestion at node i 


Di(t) 


Congestion down the stream for node i 


^D-ORCD^ 1 ) 


Selected relay for transmission at node i 


Si(t) 


Set of nodes receiving packet transmitted by node i 


Qf(t) 


Queue-length at node i destined for d at time t 


Qt(t) 


Average queue-length at node i destined for d 


p(i,d) (f) 
succ — k^ J 


Probability that highest priority node k receives packet 


p(M)(£) 


Probability that at-least one higher 




priority node receives packet 


if(M)( t ) 


Set of higher priority nodes than node i 



packet. The congestion measure of a node associated with a 
given destination provides an estimate of the best possible 
draining time of a packet arriving at that node until it reaches 
destination. Each node is responsible to update its congestion 
measure and transmit this information to its neighbors. Next, 
we detail D-ORCD design and the computations performed at 
each node to update the congestion measure. 

A. D-ORCD Design 

We consider a network of D nodes labelled by ft = 
{1, . . . , D}. Let Pij be the probability that the packet trans- 
mitted by node i is successfully received by node j. Node j is 
said to be reachable by node i, if p^j > 0. The set of all nodes 
in the network which are reachable by node i is referred to as 
neighborhood of node i and is denoted by J\f(i). 

D-ORCD relies on a routing table at each node to determine 
the next best hop. The routing table at node i consists of a 
list of neighbors Af(i) and a structure consisting of estimated 
congestion measure for all neighbors in N(i) associated with 
different destinations. The routing table acts as a storage 
and decision component at the routing layer. The routing 
table is updated using a "virtual routing table" at the end 
of every "computational cycle": an interval T c units of time. 
To update virtual routing table, during the progression of the 
computation cycle the nodes exchange and compute the tempo- 
rary congestion measures. The temporary congestion measures 
are computed in a fashion similar to a distributed stochastic 
routing computation of (4) using the backlog information 
at the beginning of the computation cycle (generalizing the 




Virtual routing table (VT) 
Compute: V L d (t) 



Actual routing table (RT) 
Store: V^ d) (T(t)) 



Control packets 



Data Packets 



[ Data Packets 



Mac Layer 



m 



-compute Q d (T(t)) 



t n* 

RX TX 



Fig. 1. Operation of D-ORCD 



computations of distributed Bellman-Ford). We conceptualize 
this in terms of a virtual routing table updating and maintaining 
these temporary congestion measures. We assume that each 
node has a common global time to ensure that the nodes update 
the routing table roughly at the same time. 

We denote the temporary congestion measure associated 
with node i G ft at time t and destinatifon d G ft as 
V d (t). Each node i computes Vf{t) based on congestion 
measures V^' (i) obtained via periodic communication with 
its neighbours k G M(i) and the queue backlog at the start 
of the computation cycle. D-ORCD stores these temporary 
congestion measures {V d (t)} deQ and {V^ d) {t)}den,keM(i) 
in the virtual routing table. More precisely, node i periodically 
compute its own congestion measure and subsequently adver- 
tises it to its neighbors using control packets at intervals of 
T s < T c seconds. Finally the actual routing table is updated 
using the entries in the virtual routing table after every T c 
seconds. The sequence of operations performed by D-ORCD 
are shown in Figs. [TJ2 

Meanwhile, for routing decisions, node i uses the entries 
in the actual routing routing table (computed during the last 
computation cycle). Let T(t) = max n {nT c : nT c < t, n G Z} 
be the ending time of the latest computation cycle. Then node 
i stores V^ (T(t)) in the actual routing table and selects the 
next best hop K^_ ORCD to minimize the packet's draining 
time, i.e. 



K%% RCD (t)= argminV^ d) (T(t)), 



(1) 



keSi(t)Ui 



where Si(i) denotes a random set of nodes receiving the packet 
transmitted by node i at time t. 

Next, we describe the distributed computations performed 
during each computation cycle. 

B. Congestion Measure Computations 

The congestion measure associated with node i for a desti- 
nation d at time t is the aggregate sum of the local draining 
time at node i (denoted by Lf(t)) and the draining time from 
its next hop to the destination (denoted by Df(t)), i.e. 



V d (t) = Lf(t)+Df(t). 
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Fig. 2. Actual routing table is updated every T c units of time while virtual 
routing table is updated after receiving any control packet 



Assuming a FIFO discipline at layer-2, we proceed to de- 
compose the local draining time. This relies on the observation 
that when a packet arrives at a node, i, its waiting time is 
equal to the time spent in draining the packets that have 
arrived earlier plus its own transmission time. If p( l,d \t) 
denotes the probability that the packet transmitted by node 
i is successfully received by a node with lower congestion 
measure, then expected transmission time at node i for the 
packet is given by P i}d( t \ - Let Qf(t) denote the number 
of packets destined for destination d averaged over previous 
computation cycle. Qf(t) is updated as 



Qt(t) = ^ 52Qf(T(t)-i). 



1=0 



The local draining time for node i to destination d at time t 
is approximated as, 



L i® ~ Pd>d)(t) + 5Z 



Qf(T(t)) 



p{i4) (t) ' i^ pwm • 



(3) 



D-ORCD computes the expected congestion measure "down 
the stream" for each node i G Vt using the latest congestion 
measure V^ (t) received from nodes fc G O with lower 
congestion measure. With respect to the destination d, a node 
k G ft is defined as a higher priority node than node i if 
Vfc (t) < Vf(t) and the set of higher priority nodes as 

H^ d \t). Let P^cl-kit) be the Probability that node k is 
the highest priority node to successfully hear node i at time t 
and k G H^ l ' d \t). As a result, the expected congestion "down 
the stream" Df(t) can be given as 



Dt(t) = J2 P sucl k W^ d \t). 



(4) 



ken 



(2) 



Remark 1. In each computation cycle, assuming T c is large, 
D-ORCD computations converge to the Bellman equation 
associated with the minimum cost ("shortest path") route in a 
network, where the link costs are given in terms of the queue 
length Qf(t). 



Remark 2. If the links success probabilities have indepen- 
dent realizations, then for all S C Q, P(Si(t) = S) = 
ELes n^5^fe(l — Pu)- The success probabilities P( %,d \t) 
and Psu C c-k(t) can ^ e calculated as 



In the next section, we discuss the practical issues associated 
with computation of the time-varying congestion measures 
Vf(t), i e ft. Furthermore, we propose practical implementa- 
tions and heuristics. 



P (i ' d) (t)= Yl P(Si(t) = S), 

s-3keSnH(^ d )(t) 



(5) 



>(M) 



1 



pV c,uj , X _ 

J succ-k\°J P(h d )(t) 



J2 P(Si(t) = S). 

S:V( k > d )(t)<V( k '> d )(t) 

(6) 



C. Opportunistic Routing with Partial Diversity 

The three-way handshake procedure discussed in Sec- 



tion II-A to achieve receiver diversity gain in an opportunistic 
scheme is achieved at the cost of an increase in the control 
overhead. In particular, it is easy to see that this overhead 
cost, which is the total number of ACKs sent per data 
packet transmission, increases linearly with the size of the 
set of potential forwarders. Thus, we consider a modification 
of D-ORCD in the form of opportunistically routing with 
partial diversity (P-ORCD). This class of routing policies is 
parametrized by parameter M denoting the maximum number 
of forwarder nodes. This is equivalent to a constraint on the 
maximum number of nodes allowed to send acknowledgment 
per data packet transmission. Such a constraint will sacrifice 
the diversity gain, and hence the performance of any oppor- 
tunistic routing policy, for lower communication overhead. 

In order to implement opportunistic routing policies with 
partial diversity, before the transmission stage occurs we find 
the set of "best neighbors" for each node i at any time t, 
denoted by B*(t), where \B*(t)\ < M. After transmission of 
a packet from node i at time t, the routing decision is made 
as follows: 1) among the nodes in B*(t)P\Si(t), select a node 
with the lowest congestion measure as the next forwarder; or 
2) retain the packet if none of the nodes in the set B* (t) has 
received the packet. Next we give a mathematical formulation 
for modifications of D-ORCD with partial diversity. 

Let B be the collection of all subsets of Vt of size less than 
or equal to M, i.e. B = {B C ft : \B\ < M}. 

In D-ORCD protocol with partial diversity, (PD-ORCD), the 
corresponding quantities Vf(t) are updated as 



vf{t) 



mm 

BeB 



Lf(t) 



E 

k:keB 



>(M) 



Psucc-kV'Wk 



M) 



(*) 



while the next hop is selected as 



K 



(M) 

PD-ORCD 



it) 



arg mm v k 

ke{Si(t)nB}ui 



M)/ 



V?"»(T(t)). 



(7) 



(8) 



We carry out a simulation study for the delay performance 
of D-ORCD with these modifications and compare it to the 
delay performance of the other routing policies in Section [TV 



Remark 3. When M = 1 each node can send packets only to 
one of its neighbors. Therefore, this routing policy cannot take 
the advantage of the broadcast nature of wireless transmissions 
anymore, and is classified as conventional routing. 



III. Implementation Details: Protocol Components 

In this section we discuss the implementation issues of 
D-ORCD which involves distributed and asynchronous iter- 
ative computations of V d (tys. We provide brief discussion 
of the basic challenges of D-ORCD including the three- 
way handshake procedure employed at MAC, link quality 
estimation, and avoidance of loops while routing. 



A. 802.11 Compatible Implementation 

1) Three way Handshake: The implementation of 
D-ORCD, analogous to any opportunistic routing scheme, 
involves the selection of a relay node among the candidate 
set of nodes that have received and acknowledged a 
packet successfully. One of the major challenges in the 
implementation of an opportunistic routing algorithm, in 
general, and D-ORCD in particular, is the design of an 
802.11 compatible acknowledgement mechanism at the MAC 
layer. Below we propose a practical and simple way to 
implement acknowledgement architecture. 

The transmission at any node i is done according to 802.11 
CSMA/CA mechanism. Specially, before any transmission, 
transmitter i performs channel sensing and starts transmission 
after the backoff counter is decremented to zero. For each 
neighbor node j G J\f(i), the transmitter node i then reserves 
a virtual time slot of duration Tack+Tsifs, where Tack is 
the duration of the acknowledgement packet and Tsifs is the 
duration of Short Inter Frame Space (SIFS) (17). Transmitter i 
then piggy-backs a priority ordering of nodes Af(i) with each 
data packet transmitted. The priority ordering determines the 
virtual time slot in which the candidate nodes transmit their 
acknowledgement. Nodes in the set Si that have successfully 
received the packet then transmit acknowledgement packets 
sequentially in the order determined by the transmitter node. 

After a waiting time of T wait = \J\f(i)\(T ACK + T S ifs) 
during which each node in the set Si has had a chance to send 
an ACK, node i transmits a FOrwarding control packet (FO). 
The FO packets contain the identity of the next forwarder, 
which may be node i itself (i.e. node i retains the packet) 
or any node j G Si. If T wait expires and no FO packet 
is received (FO packet reception is unsuccessful), then the 
corresponding candidate nodes drop the received data packet. 
If transmitter i does not receive any acknowledgement, it 
retransmits the packet. The backoff window is doubled after 
every retransmission. Furthermore, the packet is dropped if the 
retry limit (set to 7) is reached. 

B. Control Packets fidelity 

D-ORCD depends on a reliable, frequent, and timely deliv- 
ery of the control packets. As documented in |T8| , the loss 
of control packets may destabilize the algorithm operation 
and cause significant performance degradation for many well 
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when there is a sudden burst of traffic and can cause severe 
transient effects due to slow updates of the control packets. 
The looping results in large delays, increased interference and 
loss of packets ^j 

To address this issue, in our experiments we utilize an 
extension of the Split-horizon with poison reverse solution |20| 
to avoid loops. In Split-horizon with poison reverse, a node 
advertises routes as unreachable to the node through which 
they were learned. We have extended the rule to D-ORCD by 
advertising the routes as unreachable to higher ranked nodes. 
This removes most looping routes before they can propagate 
through the network. 



Fig. 3. Typical packet transmission sequence for D-ORCD when packet 
transmitted by node is received by nodes 1 and 2. 



known routing algorithms. In our implementation, we have 
taken advantage of the priority-based queuing to implement 
this component of the control plane. D-ORCD prioritizes the 
control packets by assigning them the highest strict priority, 
reducing the probability that the packets are dropped at the 
MAC layer and also ensuring a timely delivery of the control 
packets. In particular, D-ORCD utilizes priority queues: data 
packets are assigned to the lower priority queue and control 
packets are assigned to the higher priority queue. Moreover, 
D-ORCD scheduler assigns a sufficiently lower PHY rate for 
the control packets. 



C. Link Quality Estimation Protocol 

D-ORCD computations given by ^ utilize link success 
probabilities pij for each pair of nodes i, j. We now describe 
method to determine the probability of successfully receiving 
a data packet for each pair of nodes z, j G ft. It consists of 
two phases: active probing and passive probing. In the active 
probing, dedicated probe packets are broadcasted periodically 
to estimate link success probabilities. In passive probing, we 
utilize the overhearing capability of the wireless medium. The 
nodes are configured to promiscuous mode, hence enabling 
them to hear the packets from neighbors. In passive probing, 
the MAC layer keeps track of the number of packets received 
from the neighbors including the retransmissions. Finally, a 
weighted average is used to combine the active and passive 
estimates to determine the link success probabilities. Passive 
probing does not introduce any additional overhead cost but 
can be slow, while active probing rate is set independently of 
the data rate but introduces costly overhead. 



D. Loop Avoidance Heuristic 

D-ORCD approximates the solution to the fixed point 
equation via distributed distance vector approach. The classical 
problem of counting to infinity [19] in distance vector routing 
can affect D-ORCD performance due to the time varying 
nature of the congestion metric. The problem is most acute 



IV. Simulations 

In this section, we compare the expected delay encountered 
by the packets in the network under various opportunistic 
routing policies: ExOR, DIVBAR, E-DIVBAR and D-ORCD 
in Qualnet simulations. We first investigate the performance of 
D-ORCD with respect to a canonical example to demonstrate 
D-ORCD gains (6). We then use a realistic topology of 16 
nodes placed in a grid topology to demonstrate the robust 
performance improvement in practical settings. 

A. The Simulation Setup 

Our simulations are performed in QualNet. We consider two 
set of topologies in our experimental study: 

1) Canonical Example: In this example, we study the 
canonical example in Fig. [4] We motivate the perfor- 
mance improvement for D-ORCD by a scenario which 
exemplify the need to avoid congestion in the network 
by highlighting the shortcomings of the existing routing 
paradigms: shortest path and backpressure. 

2) Grid Topology: We study an outdoor wireless settings 
of grid topology consisting of 16 nodes separated by a 
distance of 200 meters. These simulations demonstrate 
a robust performance gain under D-ORCD in a realistic 
network. 

We now describe the parameters settings in the simulation. 
The nodes are equipped with 802.11b radios transmitting at 11 
Mbps with transmission power 15 dBm. The wireless medium 
model includes Rician fading with K-factor of 4 and Log- 
normal shadowing with mean 4dB. In the canonical example 
path loss is determined by pathloss matrix which gives the 
attenuation of the received signal power with distance from 
the transmitter for every pair of network nodes, while for grid 
topology the path loss follows ITM model in [21]. The antenna 
model is the standard omnidirectional antenna model with the 
default settings of the simulator. The network queues are FIFO 
with finite buffer of 750 KB. 

The acknowledgement packets are short packets of length 
24 bytes transmitted at 11 Mbps, while FO packets are of 
length 20 bytes and transmitted at lower rate of 1 Mbps 
to ensure reliability. If unspecified, packets are generated 

Similar to the broken link scenario in a typical distance vector routing. 
2 Packet loss occurs when time to live (TTL) value exceeds the number of 
allowed hops (typically 64) 



according to a poission modulated Markov traffic. The packets 
are assumed to be of length 512 bytes equipped with simple 
cyclic redundancy check (CRC) error detection. The control 
packets are transmitted periodically at an interval of T s = 0.5 
seconds. 

We have chosen partial diversity M = 4 and update 
frequency T c = T s = 0.5 seconds in our experimentations. 
A discussion on the choice of parameters in the design of 



D-ORCD is provided in Section [TV-D 

In our study, we have compared the performance of 
D-ORCD against the state of the art routing algorithms. Before 
we proceed, we describe these candidate algorithms as well 
as our implementation of them. 

• DIVBAR (22j: We implemented DIVBAR to select the 
next hop based on a weighted differential backlog. Specif- 
ically, let Qy '(t) denote the latest information at node i 
about the number of packets buffered in queue k destined 
for destination d. For any destination d, DIVBAR chooses 
the next hop K BI y BAR (t), such that 



K 



(i,d) 
DIVBAR 



(t) = 



argmin (<%(£) 

keSi(t)Ui 



??(*))• (9) 



We have created virtual queues for each destination 
to identify differential backlog associated with different 
destinations. Note that original backpressure algorithm 
proposed in [22] is done in conjunction with a scheduler 
to maximize the network's overall weighted differential 
backlog as well as a mechanism to choose destination 
queue to be served. In our implementation, we serve the 
packets in a prioritized manner based on the destination 
using 802.11 MAC. Specifically, packet with destination 
m(t) is selected among all possible virtual queues such 
that 



m(t) = argmin{min(QJk (t) 

d k 



Qi(fi))}- do) 



In order to implement a priority scheduling we utilize 
a priority scheduler such that the packet destined for 
m(t) is assigned higher priority queue. We have imple- 
mented the DIVBAR algorithm using a structure similar 
to D-ORCD (in which V d (t) is replaced with Qf(t)). 
ExOR |3] : ExOR uses ETX metric when routing the 
packet without considering queuing information at the 
nodes. Specifically, for a packet destined for node d, the 
next hop K% x q R is chosen such that 



K 



(M) 

ExOR 



(t) = argmin ETX^ d \ (11) 

keSi(t)Ui 



where ETX^ k,d ^ is the minimum number of transmis- 
sions from node k to destination d given by, 

1 



ETX^ k,d ^ 



min { 

3 ^Pkj 



■ETX^ d) }. (12) 



We have used our distributed architecture for the calcu- 
lation of ETX metric by taking Qi (t) = 1 for all i 6 O 
and M = 1 in the calculation of Vi(t), even though, in 
principle, the overhead can be held much lower due to 
the time invariant nature of node ordering. 




Fig. 4. Structure of the canonical network from |6|. The fractions on the 
links show the probability of successful transmission on each link. 



E-DIVBAR (7): E-DIVBAR is a variant of DIVBAR, 
where along with the queue information, ETX metric is 
used for path selection. In particular, for a packet destined 
for d, the next hop K B _ DIVBAR is chosen such that 



K 



E-DIVBAR 



(*) 



arg mm 

keSi(t)Ui 



{(Q^ d \t) 

£TX (M) j. 



(13) 



E-DIVBAR algorithm is also implemented using a struc- 
ture identical to D-ORCD and DIVBAR, however, the 
control packets contain information about the queue- 
length as well as the ETX for a given destination. 
The commodity selection is performed using the same 
equation ([l0j> as DIVBAR. 

Next, we study the canonical example where we compare 
the average delay encountered by packets in the network under 
various routing policies: ExOR, DIVBAR, E-DIVBAR and 
D-ORCD. The choice of the canonical network enables us 
to clearly reveal the high capability of D-ORCD in balancing 
the traffic taking advantage of path diversity in the network. 

B. Performance of D-ORCD: Canonical Example 

Consider the network shown in Fig. [4] which is parameter- 
ized by N. Nodes 12, 13, . . . , 12 + (N - 1) form a "hole" in 
the network whose size is controlled by the parameter TV. We 
now discuss the delay gains under D-ORCD as parameters N 
and Ai (the incoming traffic rate at node 1) are varied and 
verify them in this section. 

Note that the source node 1 can route packets either through 
node 2 or node 3. Since only node 1 has a routing choice we 
focus on the delay experienced by packets originating in node 
1. Fig. [5] provide plots of the average end-to-end packet delay 
and the buffer overflow ratios for all the routing algorithms 
as the arrival rate Ai is varied. We observe that D-ORCD 
has better delay performance than the other algorithms over 
the range of incoming traffic rates considered. Fig. [6] plots 
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the highest priority next hop for node 1 under the candidate 
protocols throughout the duration of the experiments. 

ExOR gives higher priority to node 2 than node 3 inde- 
pendent of the congestion at intermediate nodes (ETX^ 2,7 ^ = 
2.53 and ETX&V = 4.36). ExOR can thus suffer from poor 
delay performance as the arrival rate at node 2 approaches 
capacity. ExOR has the worst delay performance among all the 
algorithms as seem in Fig [6] particularly when the traffic load 
on the network is high. In Fig. [6] we observe that DIVBAR and 
E-DIVBAR forward significant number of packets into 12,13 
and 14 increasing the interference and packet drops as well as 
delay. 

Next, we study the impact of the size of the "hole"; i.e. 
N on the expected per packet delay. Under DIVBAR the 
packets that arrive at node 2 from source 1 are likely to be 
forwarded and wander between nodes 12, 13. ..,12 + (N — 1) 
before eventually forwarding to 4. In contrast, increasing TV 
has no effect on the performance of D-ORCD. This is because 
V<J(t) < V? 2+i (t), i = 0, 2, . . . , N - 1, for all time slots t 9 
in effect, preventing the packets to enter the "hole". Fig. [7] 
provides the expected delay encountered by the source packets 
under various routing policies, as the size of the "hole", N, 
increases and the arrival rate is set to low value of Ai = 200 
kbps. The figure shows that the average delay under D-ORCD 
is significantly lower than other candidate protocols as N 
increases from 1 to 5. 



C. Performance of D-ORCD: Grid Topology 

We perform simulations for the grid networks of 16 nodes in 



Fig. 8(a) and 8(b) UDP Traffic is injected at each node i G ft, 



with poison distributed packet arrivals. Figure 9(a) shows the 
expected delay versus the arrival rate under various routing 



policies for the network in Fig. |8(a)| Under ExOR, packets 
are always routed opportunistically along the "shortest path" to 
the destination which results in high delay under heavy traffic 
scenarios. On the other hand, DIVBAR, E-DIVBAR, and 
D-ORCD are throughput optimal and hence, they distribute 
the traffic to ensure bounded average delay for all traffic 
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Fig. 6. Highest priority nodes for Canonical Example. 



rates inside the stability region. The performance gap between 
DIVBAR and E-DIVBAR follows from the fact that DIVBAR 
does not use any metric of closeness to the destination when 
routing the packets; while E-DIVBAR takes into account the 
ETX of the nodes. A more interesting observation is the 
comparable performance of D-ORCD and E-DIVBAR. In 
other words, in network |8(a)| the mere addition of ETX and 
queue measures in E-DIVBAR perform sufficiently well. 

Next, we consider the network shown in Fig |8(b)| a modifi- 
cation of the network shown in Fig 8(a) in which link qualities 
are changed due to the existing barriers in the network. 
Figure |10(a)| shows the delay performance of the candidate 
routing policies for this network as the traffic load varies. 
Again, ExOR and DIVBAR show large delay. But, unlike in 
the case of network shown in Fig |8(a)| the performance gap 
between D-ORCD and E-DIVBAR is now rather significant. 
The reason is that D-ORCD always route packets along the 
least congested paths to the destination (without assuming 
the network topology and the arrival traffic). In other words, 
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(a) Average delay per packet delivery for Network shown in Fig 1 8 (a) 
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Fig. 8. Grid topology of 16 nodes (4 x 4). Node 1 is assumed to be the 
destination 



the performance of E-DIVBAR exhibits high dependence on 
the underlying network topology and the arrival traffic: E- 
DIVBAR performs well in symmetric networks with equal 



arrival rate to all nodes (e.g. the network of Fig 8(a) ), while, 
it performs poorly in non-symmetric networks under non- 
uniform traffic patterns. 



D. Choice of Parameters 

Next, we investigate the performance of D-ORCD with 
respect to the design parameters in the grid topology of 16 



nodes in Figure |8(a)| It provides significant insight in the 
appropriate choice of the design parameters such as choice 
of partial diversity M and choice of computation cycle T. 

1) Choice of partial diversity M: We focus on character- 
izing the trade-off between performance and overhead cost 
for D-ORCD. We consider modifications of D-ORCD with 
partial diversity to decide on the number of neighbors M 
which acknowledge the reception of the packet. In particular, 
we compare the delay performance as well as the overhead 



cost of D-ORCD. Figure 10 shows the average delivery time 
of each packet versus the number of M for Network shown 
in Fig 1 8 (a) | Figure 10 illustrates the trade-off between the 
delay performance and overhead cost D-ORCD. We note that 
limiting the size of the neighbor set to 4 provides the best 
trade-off. 

2) Choice of computation cycle interval T c : D-ORCD 
throughput optimality as we will discuss in Section |V| requires 
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responsive version of ^ at the cost of provable throughput 
optimality, where T c is set to T s = 0.5 seconds. 
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that computation cycle interval to be sufficiently large. How- 
ever, to ensure a better delay performance, T c must be chosen 
sufficiently low to make the routing decisions more responsive 
to the instantaneous congestion. In particular, as T c increases, 
the chosen routing paths i) utilizes outdated queue lengths 
and ii) keeps the routing policy fixed for longer durations 
independent of current queue-lengths. In Figure [TT] we plot 
the performance of D-ORCD as T c varies in terms of multiple 
of T s . We observe that for high load, the choice T c = T s 
outperforms other values for T c . We have chosen a more 




Fig. 11. Delay Performance for D-ORCD for Network shown in Fig |8(a)| as 
T c varies 



V. Theoretical Guarantees 

In this section, we provide a theoretical guarantee regarding 
the throughput optimality of D-ORCD under the assumptions 
that i)the flows in the network are destined for the single 
destination node D (for multi-destination extensions see [23]), 
ii) link probabilities are time invariant iii) the routing decisions 
and the successful reception at set S due to transmission from 
node i is acknowledged perfectly to node i. 

Before we precisely state the optimality, we define few 
notations. We define a routing decision [i^ (t) to be the number 
of packets (upto 1 packet) whose relaying responsibility is 
shifted from node i to node j during time slot t (^u(t) = 1 
means that i retains the packet). Note that fiij(t) forms the 
departure process from node z, while it creates an endogenous 
arrival to node j. Without loss of optimality, we assume that 
pa = 1 and ii iD {t) = 1, if D e Si(t). 

Definition 1. A routing policy is a collection of causal routing 
decisions U ijje n U£l {/%•(£)}. 

Let Ai(t) represent the amount of data that exogenously 
arrives to node i during time slot t. Arrivals are assumed to 
be i.i.d. over time and bounded by a constant A max . Let A^ = 
E[A^(t)] denote the exogenous arrival rate to node i. We define 
A = [Ai, A2, . . . , Xn] to be the arrival rate vector. Let Qi(t) 
denote the queue backlog of node i at time slot t. We assume 
any data that is successfully delivered to the destination D 
will exit the network and hence, Qoif) = for all time slots 
t. We define Q(t) = [Qi(t), Q 2 (t), . . . , Q D -i(t)] to be the 
vector of queue backlogs of nodes 1, 2, . . . , Z) — 1. 

The selection of routing decisions under a routing policy II 
together with the exogenous arrivals impact the queue backlog 
of node i, i G ft as: 

o?(*+i) = [Q?(*)-£^-(*)] + 

3 en 

+ z2 $* W 1 {QJ I W>^W} + A i (*)> 

jen 

where the superscript II emphasizes the dependence of queue 
backlog dynamics on the choice of policy II. 

Definition 2. Given an ergodic exogenous arrival process with 
rate A, a routing policy II is said to stabilize the network 
if Qto t {t) is ergodic and E[Qj£ t (£)] remains bounded when 



10 



packets are routed according to II. The stability region of the 
network (denoted by 6) is the set of all arrival rate vectors 
A for which there exists a routing policy that stabilizes the 
network. 

Definition 3. A routing policy is said to be throughput optimal 
if it stabilizes the network for all arrival rate vectors that 
belong to the interior of the stability region. 

Fact 1 (Corollary 1 in (7)). An arrival rate vector A is 
within the stability region (5 if and only if there exists 
a stationary randomized routing policy that makes routing 
decisions {fiij(t)}ijen, solely based on the collection of 
potential forwarders at time t, {Si(t)}i e n, and for which 
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>A fc . 



We are ready to present Theorem [T] regarding the optimality 
of D-ORCD. 

Theorem 1. Suppose T c = 0(D) and M = D. Then D- 
ORCD is throughput optimal 

The proof of Theorem [T] is based on the Foster-Lyapunov 
Theorem. For completeness, the structure of the Lyapunov 
function and a sketch of the proof is provided in the Appendix. 
By Theorem [T] under D-ORCD, the average total queue 
backlog remains bounded. Little's theorem implies that under 
D-ORCD, expected delay is bounded. 

Remark 4. Assumptions for optimality of D-ORCD could be 
relaxed in many cases. 

1) The packet transmission on a link (i,j) is assumed to 
be successful with probability pij, and transmissions on 
links were assumed to be independent of each other. The 
computations in ^ and ( [T4| ) can be generalized to in- 
corporate correlated link qualities, by replacing the term 
(Tikes P*k) (Uits0--Pn)) withP(5|i) in the definition 
of P^ d \t) and P^_ k (t) 9 where P(S\i) denotes be 
the probability of the event {Si(t) = S}. Furthermore, it 
is straight forward to show that the throughput optimality 
of D-ORCD is robust to all channel estimation errors, 
even though, erroneous link models, in general, can 
significantly degrade its delay performance. 

2) In this paper, we assumed that the network topology 
and the probability of successful transmissions are time- 
invariant. The generalization to the case of time- varying 
network topology with stationary transmission probabil- 
ities is straight forward |24|. 



VI. Conclusions and Discussions 

In this paper, combining the important aspects of shortest 
path routing with those of backpressure routing, we provided 
a distributed opportunistic routing policy with congestion 
diversity (D-ORCD) is proposed under which packets are 
routed according to a rank ordering of the nodes based on 
a congestion cost measure. Furthermore, we show that D- 
ORCD allows for a practical distributed and asynchronous 
802.11 compatible implementation, whose performance was 



investigated via a detailed set of QualNet simulations under 
practical and realistic networks. Simulations show that D- 
ORCD consistently outperforms existing routing algorithms 
in practical settings. 

In D-ORCD, we do not model the interference from the 
nodes in the network, but instead leave that issue to a classical 
MAC operation. However, the generalization to the networks 
with inter-channel interference follows directly from [7]. The 
price of this generalization is shown to be the centralization 
of the routing/scheduling globally across the network or a 
constant factor performance loss of the distributed variants 
(7), (10), (25) . In future, we are interested in generalising D- 
ORCD for joint routing and scheduling optimizations as well 
consider system level implications. Incorporating throughput 
optimal CSMA based MAC scheduler (proposed in [26]) with 
congestion aware routing is also promising area of research. 

The design of D-ORCD requires knowledge of channel 
statistics. Designing congestion control routing algorithms to 
minimize expected delay without the topology and the channel 
statistics knowledge is an area of future research. 
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Appendix 

We provide a sketch of the proof for the throughput opti- 
mality of D-ORCD for a connected network[j 

A. Relationship to Centralized ORCD 

We prove the throughput optimality by relating D-ORCD 
update equation ^ to the convergence of closely related fixed 
point equation. In particular, we relate the routing decisions for 
D-ORCD with the decisions taken according to the congestion 
measures {V*(t)} obtained from the fixed point equation: 



v*(t) 



i(t) 



p^ D )(i) 



£ 



_ succ-k\ L ) 
P^ D )(t) 



v^t)- d4) 



k:H(*> D )(t) 

We refer to the centralized routing algorithm which makes 
decisions at each instant according to V*(t) as C-ORCD. 
Following lemma states a relationship between D-ORCD and 
C-ORCD. 

Lemma 1. Assume T c is sufficiently large (T c ~ 0(D)). Then 
during T(t) < t < T(t + T c ), |2]) converges to the fixed 
point equation (14), i.e. {V^iTit + T c )} ie Q solves (14) and 
VP(T(t + T c )) = V?(T(t)). 

Proof: The convergence V® (t) -+ V*(T(t)) during 
T(t) < t < T(t + T c ) follows by relating ^ to the 
Bellman-Ford algorithm with fixed link cost. It is known from 

3 In connected network each node has a positive probability path to the 
destination. If a node has no path to the destination, it cannot sustain any 
traffic and can be ignored without loss of generality. 



|27] Theorem 2.4] that asynchronous distributed Bellman- 
Ford algorithm converges in finite time when the control 
packets are instantaneously received (or control packets are 
timestamped and older packets are discarded). Furthermore, 
with high probability, the time until the termination of the 
asynchronous Bellman-Ford algorithm is O(D), where D is 
the number of nodes in the network. ■ 

Note that when implementing D-ORCD, we broadcast con- 
trol packets using high priority and the control packets do not 
undergo backoff. This ensures that with high probability the 
packets are instantaneously received. Thus the convergence in 
Lemma [T] is justified. 

We now provide the proof for the throughput optimality 
of D-ORCD for T c ~ 0(D). To simplify the notations, let 
policies in C-ORCD and D-ORCD be denoted by 7r* and n 
respectively. In (13), the authors constructed an appropriate 
Lyapunov function L* to show that C-ORCD is throughput 
optimal. In particular it is shown that: 



Fact 2. There exists a Lyapunov function. L* : R^ 
such that for all time slots t and B > 0, e > 0, 



->■ 



N 



E 



L*(Q* (t+l))-L*{Q(t))\Q(t) 



<B 



(15) 



fc=i 



where superscript 7r* in Q n implies the dependence of 
backlog vector on the routing policy 7r*. 

To prove throughput optimality of D-ORCD, it suffices to 
show that the Lyapunov drifts under 7r* and tt have a bounded 
difference. More precisely, 

Lemma 2. Let L* be the Lyapunov function as proposed in 
$13}. Then for B" > 0, 



L*(Q*(t+l))|Q(*) 



■E 



L*(Q* (t+l))\Q(t) 



<B h 



Lemma [2] together with ( p"5) implies the existence of Lya- 
punov function with negative expected drift i.e. for Lyapunov 
function L*, there exists B' > 0, e' > such that, 



N 



E 



L*(Q*(t + 1)) - L*(Q*(t))|Q(t) <B f -e f Y, Qktf) 



k=i 



The details of the construction of L* and the proof of 
Lemma [2] is provided in Appendix [C] 

B. Review of C-ORCD results 

Before proceeding, we introduce some notations. Let [x} + 



set of nodes {1,2,..., D}, i.e., U^C; = {1, 2, . . . , D} and 



a n c< 



i^J- 



Definition 5. A rank ordering R = (Ci, C2, • • • , Cm) is 
referred to as path-connected if for each node i G C&, 
1 < fc < M, there exist distinct nodes ji, J2, • • • , ji € C k ~ x 
such that pij t > 0,p Jlj2 > 0, . . . : Pj l d > 0. The set of all 
path-connected rank orderings is denoted by 7Z C . 

Let / be a bivariate function of the following form: 
1 



f(m,n) 



for all m > 0, n > 0, 



K m (K n - 1) 

where K = 1 + ^- for p min = min{p# :i,j'G ft,p^- > 0}. 

In p3) , the authors proposed a method that utilizes the 
bivariate function / and partitions the space of queue backlogs, 
R+, into \1Z C \ cones denoted by {D c AR)} Renc . The piece- 
wise Lyapunov function, L% : R^ — » R + , is then constructed 
by assigning to each cone Df(R) 9 R = (C±, C2, . . . , Cm) 6 
7£ c , a weighted quadratic function of the form: 



A I 



L f (Q,R) = J2f(\C i - 1 \,\C i \)Q 2 Ci , (16) 



where Qc(f) = E Qi(f)- More precisely, 

iec 



L}(Q)= J2 L f (Q,R)l {QeDCf{R)} . (17) 



Ren c 



Let us consider the Lyapunov drift when Q(t) G D C JR) for 
some R = (Ci, C2, • • • , Cm) € 7£ c . Since the collection of 
cones {D c AR)} Re -jz c partitions R+, we define function Uf : 

l]xi^i + such that 



U f (k,Q) = f(\C i - 1 l\C i \)QcM 



(18) 



where Q G D c f (R), R = (Ci, C 2 , • • • , C M ), and fc G C*. 

Let {M*j(^)}i,jG^ represent the routing decisions 
under C-ORCD, while {P>ij(t)}ijen represent the 
routing decisions under D-ORCD. For ease of 

notation and exposition define Ac(t) = Yl Ai(t), 

iec 

VC,in(t) = E/c=lEjGC/ i fci( t ) 1 {Qfe(t)>l}' and 

»c,out(t) = E Ef=i^j(t)l{Q fe (t)>i}. We have, 

/cGC 



L}(Q(*+l))-L}(Q(t)) 

M 

= S/Cic* -1 !, ic*i) [q|;,(* + 1) - g?7 4 (*)] 



1=1 



-0(||Q(t + l)-Q(i)|| 2 ) 



Deiore proceeuing, we introduce some notations, i^et [x\ ■ = m 

max{x,0}. The indicator function 1 {X} ^ takes the value 1 (9 _ 2 ]T/(|C i - 1 | ) ICiDQcW^CoutW - /*c„in(t) 



whenever event X occurs, and otherwise. For any set S 
\S\ denotes the cardinality of S, while for any vector v, 
\\v\\ denotes the euclidean norm of v. When dealing with a 
sequence of sets Ci, C2, . . . , we define C 1 = Uj =1 Cj. 

The following definitions are required in order to identify 
the Lyapunov functions for C-ORCD and D-ORCD. 

Definition 4. A rank ordering R = (Ci, C2, . . . , Cm) is an 
ordered list of non-empty sets Ci, C2, . . . , Cm (1 < M < D), 
referred to as ranking classes, that make up a partition of the 



2=1 



i\ / 



A Ci (t) +0(1) 



-2^2f(\C i - 1 \,\C i \)Q Ci (t)hQ,.(t)>i} 



D 



(E E A**i(*) -EE /*«(*) - ^(*)) + °( 1 )> 

(19) 



j=i feeCi 



fc=i jeCi 



12 



where (a) follows from continuity and differentiability of 
L* f |I3| Lemma 3] and writing L* f (Q(t + 1)) in terms of its 
first-order Taylor expansion around L*AQ{t)), and (b) follows 
from Fact [3] below. 



Fact 3 ( (13)). Let R = (Ci, C 2 , . . . , C M ) € ft and Q(t) e 
£>/(#). We have 

Qc<(* + i)-Qc,(*) = 

ft - 2Q Ci (t)(n Cit out(t) - Vc u in{t) - A Ci (t))i 
where f3f is a constant bounded real number. 

Finally from {[8} and ([19]), 
L}(Q(t + l))-LJf(Q(*)) 

M D 

z=l /cGQ J=l 
M D M 

- E EE [f /(w)»( t ) 1 w.w>') - E A ^(*) +o(i) 

i=l ^Ci fc=l 
D D 

= ~ 2 ^2Y1 U f( k ' Q)^kl(t)l{Q ki t)>l} 



In order to prove Lemma [2] it suffices to show that 

U f (b, Q(t)) - U f (a,Q(t)) = 0(\\Q(t) - Q(t)\\). (24) 

Consider the line that connects Q(t) and Q(t) in R+. 
Suppose this line goes through M — 1 cones in R+. Let 
Z\ , Z2 , • • • , ^m be respectively the intersection of the line 
connecting Q(t) to Q(t) with the M separating hyperplanes 
of the M — 1 cones between them, i.e. 



\\Q(t)-Q(t)\\ 

= \\Q(t)-Z 1 \\ + \\Z 1 -Z 2 \ 



'M 



Q(t)\\. 



i=l 



k=l 1=1 
D D 



M 



~ E E u f<!> Q)m(t)i {Qk( t)>i} - E ^(*) + °(!)- 

fe=l 1 = 1 i=l 

(20) 

Fact 4 ( |T3|). Routing decisions under C-ORCD are such that 
li\ 3 = 1, only when j G ^(t) and [//(j, Q(t)) < U f (k, Q(t)) 
for all k e Si(t). 

This fact together with pQ| provides the proof of Fact |2] 

C. Proof of Lemma^ 

We begin the proof of Lemma [2] by stating following Claim. 

Claim 1. Routing decisions under D-ORCD are such that 
ftij = 1, only when j E Si(t) and Uf(j, Q(t)) < Uf(k,Q(t)) 
for all k e Si(t), where Q(t) = Q(T(t)). 

With this, we are ready to proceed with the proof of 
Lemma |2] 

E[L* f (Q*(t + l))\Q(t)] - E[L* f (Q*\t + l))\Q(t)] 



= E 



D D 



2EE(^w-^w)( c/ /^ ( ?w) 



fc=i /=i 



£//a,Q(t))l Wlt ( t )>i}|Q(t) 



■0(1), (21) 



where equality follows from (20). 

Suppose node z's transmission at time t is received by 
potential forwarders Si(t). Furthermore, suppose that nodes 
a, b G Si(t) are the nodes with the highest rank under C- 
ORCD and D-ORCD respectively, i.e. /ij (t) = jl(t) ib = 1. 
From Fact |4] and Claim [T] we have 



U f (a,Q(t)) < U f (b,Q(t)), 
U f (a,Q(t)) > U f (b,Q(t)). 



(22) 
(23) 



Note that since Z\ , Z2 , • • • , ^m are on the 
hyperplanes, every two consecutive points in set 
{Q(t\ Z\, Z2, • • • , ^m> 0W} can be considered to belong 
to the same cone, and hence, have same rank ordering of the 
nodes. From definition of function Uf, we obtain 

\U f (a, Q(t)) - U f (a, Z x )| = 0(\\Q(t) - Z 1 1|), 
|C7/(a, Z m ) - C7/(a, Z m +i)| = 0(\\Z m - Z m +i||), 1 < m < M, 
|[/ / (a,Z^)-[/ / (a,Q(t))| = 0(||Z^-Q(t)||). 

Therefore, 

U f (a,Q(t))-U f (a,Q(t)) 

= [U f (a, Q(t)) - U f (a, Z x )} + [U f (a, Z x ) - U f (a, Z 2 )) 
+ ■■■ + [U f {a, Z M ) - U f (a, Q(t))} = 0(\\Q(t) - Q(t)\\). 

We can derive the same result for all other nodes in the 
network. In other words, there exist constants r] ai 775 such that 

U f (a,Q(t)) = U f (a,Q(t))^r 1a \\Q(t)-Q(t)l(25) 

U f (b,Q(t)) = U f (b,Q(t))+rn,\\Q(t)-Q(t)\\. (26) 

However, ([22]), ([23]), ([25]), and ([26]) imply that r\ a < rj b and 



U f (b,Q(t)) -U f (a,Q(t)) < ( Vb - Va )\\Q(t) - Q(t)\\- 

(27) 

With this, the proof is now complete. 
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